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Abstract 

The main purpose of this research note is to show that the triality theory can 
always be used to identify both global minimizer and the biggest local maximizer 
in global optimization. An open problem left on the double-min duality is solved 
for a nonconvex optimization problem with double- well potential in , which 
leads to a complete set of analytical solutions. Also a convergency theorem is 
proved for linear perturbation canonical dual method, which can be used for 
solving global optimization problems with multiple solutions. The methods and 
results presented in this note pave the way towards the proof of the triality 
theory in general cases. 

Keywords: Canonical duality theory, Triality, Double-well potential. Global 
optimization, Nonlinear algebraic equations. Perturbation. 

1. Primal Problem and Motivation 

We are interested in analytical solutions to the following global minimization 
problem {{V) in short): 

{V) : min{n(a;) = W[x) - (x, /) | a; G ffi"}, (1) 
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where / G is a given vector, (x, /) represents the inner product in JR", and 
W : 5?" — > is a fourth order polynomial of the form 

in which, a and A are given positive parameters. 




(a) Function 11 when n, f,a = 1 and (b) Function 11 when n = 2, / = 0, 
A = 3. a = 1 and A = 3. 

Figure 1: Graphs of Il{x) 



The non-convex problem (V) appears extensively in many applications of 
sciences and engineering. For example, in the case that n — I, Il{x) is a double- 
well function (see figure [Ta|) . which was first studied by van der Waals in thermal 
mechanics in 1895. If n = 2 and / = this is the so-called Mexican hat function 
(see Figure llbp in cosmology and theoretical physics. Due to the nonconvex- 
ity, the function Tl{x) may possess multiple critical points, determined by the 
necessary condition 

Vn(a;) =a Q|a:|2-A^ x-/ = 0. 

Direct methods for solving this nonlinear algebraic equation are difficult, and 
to identify the global minimizer is a main task in global optimization. 

If instead of the function W considered above, we were to consider the func- 
tion Wb-.M^^IR defined by 

Wb{x) ■.= '^(^-\Bx\^~\j , 
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where B : J?" — > M"^ is a linear transformation (not identically zero), now the 
function n(x) = Wb{x) — (/, x) gives a more general case for problem (P). Yet, 
if we take / e R{B*B), we can always reduce (P) to the case where B = I 
in the following way: make y = Bx and let / = B{B* B)'^ f , where {B^B)'^ is 
the Moore-Penrose pseudoinverse of B^B (see Q], [l2| and references therein). 
Notice that since / e R{B^B) then B*/ = / and 

{f,x)^{B'~f,x)^(f,Bx)^(f,y). 

With this, we can define the function Hb ■ R{B) — > M where 

nB(y) = f Q|yp-A)'-(7,y). 

If 2/0 G -R(^) is a solution of IIb, there must exist a xq G -K" such that 
Bxq — 2/0, then 

B*B.To = B*2/o 

and from this, we can take xq = {B*^ B^ B*yo as a solution for H. Thanks to 
this, we will study only the case when B = L 

Canonical duality theory developed in [s] is potentially powerful for solving 
a large class of nonconvex/nonsmooth/discrete problems in both analysis and 
global optimization 0,0,3- This theory is composed mainly of (a) a canoni- 
cal dual transformation, (bj_^a complementary-dual principle, and (c) a triality 
theory. It was shown in 4] that by the canonical dual transformation, the 
fourth-order nonconvex problem {V) is equivalent to an one-dimensional canon- 
ical dual problem which can be solved analytically to obtain all critical points. 
The complementary-dual principle shows that a complete set of solutions to the 
primal problem can be represented analytically by these canonical dual solu- 
tions. By the triality theory, both global minimizer and local maximizer can 
be identified. However, it was discovered in 2003 that in order to identify local 
minimizer, the triality theory proposed in Q needs "certain additional con- 
straints" (see Remark 1 in 4]). Therefore, the double-min duality statement in 
this triality theory was left as an open problem in global optimization j5j]- 
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The canonical duality theory and the associated triality have been challenged 
recently by Voisei and Zalinescua in a set of more than seven paperj^. Unfortu- 
nately, in these papers, they either made mistakes in understanding some basic 
terminologies of finite deformation mechanics, or repeatedly address the same 
type of open problem for the double-min duality left unaddressed by Gao in 
0,0]. For example, the external energy F(u) in conservative systems (the case 
studied by Gao and Strang in [l^) means that the gradient VF{u) must be a 
given external force field. Therefore, the function(al) F{u) in Gao and Strang's 
work can not be quadratic. However, in their paper published recently in Ap- 
plicable Analysis, quadratic F{u) has been used by Voisei and Zalinescua in 
all "counterexamples" . Also, interested readers should find that the references 
, where the open problem was remarked, never been cited in any one of 
their papers. 

The main purpose of this paper is to solve this open problem such that 
the proposed problem (V) can be solved completely. The method and results 
presented in this paper h.ve been nsed .o prove^he tri.li.y .leory for global 
optimization problems with general polynomials [11] and general objective func- 
tions HQ. 

2. Canonical Dual Problem and Analytical Solutions 

Following the standard procedure of the canonical dual transformation, first 
we need to choose a geometric operator A : JR" — > [—A, +oo) given by the 
following function 

and the associated canonical function V : [—A, +oo) 1R+ defined by 

Therefore, the primal function H can be reformulated as 

n{x) = V{A{x))-{f,x). 



^See the web page at |http: / /www. math. uaic.ro/~zalinesc/reports. htm| 
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By the Legendre transformation (see [l], [l^, 13), the conjugate function 
V : [—aX, +00) — > is given by 

With this, the Gao-Strang total complementary function S : x [— aA, +00) — 
M, associated to the problem (V) can be defined as follows: 

Via this E!(x, the canonical dual function 11'* : [—a\, +00) — > 5? can be finally 
obtained by [4| 

n'^CO ^sta^ S(x, <?) = {S(a;o, t)| V:,S(xo, = 0} 
= — k 7; ^A, Vi; e [-aA, +00), 

where the notation sta{*} stands for finding stationary points of the function 
given in {*}. 

Notice that if <^ > then the dual function n'^(<;) is strictly concave which 
admits a unique global maximizer; however, is a d.c. function (difference 

of convex functions) on [— ckA,0), which should give us information about local 
extrema of the primal function 11. Therefore, the canonical dual problem is 
proposed in the following stationary form: 

(7"*): sta n'*(?) = {n'*(^o)|vn^(^o) = o}. (2) 

By the fact that the canonical dual problem {T"'') has only one variable, the 
criticality condition Vn''(<;) = 0, where 

Vn'*(,) = ^-i-A, (3) 

leads to a quebec algebraic equation 

2e{^ + x)^\f\', (4) 
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which can be solved explicitly to obtain all three possible real solutions 

a ■ X 

1/3 , V 2 y 

9ri/3 

^3 = hr-o -^ +^ ^3 



^1 - ^ + 9^1/3 3 

^2 = (-V-o)-'^' + ^ ^^^3 (6) 



9rV3 

■ I/I y^27 1/1^-8^2- A3 27a-|/|^-4a3.A3 
/I . Q# ins 



where 

a ■ , 

4^3! ^ 10^ 

It is not difficult to show that if |/p > ^0^X^/27 then <;i is the only real 
positive root and if |/p = ^a^X^ /27 then <ji is positive, and ^2 = ^3 = — 2q!A/3. 
IfO<|/p 



root and if |/p = ^a^X^ /27 then <ji is positive, and ^2 = ^3 = —2aX/i 
< 8a2A3/27, equations dS])-© can be simplified further to obtain: 

^(-(r"-'(S^-0)-0 



a. 



Moreover, we will have that <;i > > ^2 > — 2q:A/3 > ^3 > 



-aX. 



I 

I 

-10 - / 



Figure 2: The function 2<;'^{c, + a A) with aA = 3. 
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Theorem 1 (Analytical Solutions [J]). Let f e JR" \ {0} and {q} be the 

real roots of Equation Then, Xi — f/(^i are stationary points of (P) for 

every i and 11(2;^) = 



Proof: Notice that A{xi) = ft/a, we have 
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but since q is sohition of we have 

A(a;,)= (^+a) -A = ^. (11) 
Now, if we differentiate the function 11 we will have 

Vn(x) = aA{x)x - / (12) 

and so 

VU(x,) = aA{x,)x, -f = a---^-f = 0. 
On the other hand 

and 

so we have Il{xi) = W^i^^i) as expected. ■ 



Theorem 1 shows that the stationary points of the dual problem induce 
naturally stationary points of the primal with zero duality gap. Using (|12[) . 
it can be seen that if any stationary point of 11 exists, it must be in the same 
direction of /. Therefore, by analyzing the function W{rf) with ?' G -K it can be 
seen that the possible stationary points of W{rf) satisfy the following equation: 

«^(yl/P-A) =1. (13) 

Since / 7^ 0, then r 7^ and by substituting r — 1/? in we will have 
Thus, problem {V) has at most three critical points. In the next section, we 
will show that the extremality of these solutions can be identified by a refined 
triality theory. 
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3. Triality Theory and Perturbation 

The foUowing spaces are important for understanding the triahty theory: 

(14) 





(/,a;> 


< 




I/IN 








> 




I/IN 





^2 

>J^^^\- (15) 



2?2 + 2aA , 

Theorem 2 (Refined Triality Theory). Let f G WC be a given vector such 
that < l/p < 8a^A'^/27, {q} to^/i i = 1,2,3 the three real roots of Equation 
([4]) such that <ji > > ■^2 > — 2q!A/3 > > — aA anrf Zef = //q- T/ien we 

i) xi is a global minimizer ofH, is a maximizer ofH'^ in (0, +cx)), and 
n(2;i) = min n(a;) = max {<;) ^ . (16) 

xeM" (;e(0, + oo) 

a) There exist Xg and Iq neighborhoods of x^ and ^3 respectively such that X3 
is a local maximizer ofIl{x) in Xq and c^s is a local maximizer ofIl'^{(;) in 
lo, and 

n(x3) = maxn(a;) = maxff'(^) = n'^(<^3)- (17) 

Hi) There exists Ii a neighborhood of (^2 such that ^2 is a local minimizer of 
n''(<;) in Ii and X2 is a saddle point ofIl{x). Specifically, X2 is a local 
maximizer ofH{x) in the directions X2 + tX^ and a local minimizer ofIl{x) 
in the directions X2 + tX\,, i.e., 

n{x2) = maxn(a;2 + tX^) = minn'^(<r) = ^^{^2). (18) 

tSiR <;e/i 
W[X2) = minn(:E2 +tX\,)= minn''(^) = n'^(^2). (19) 

Proof: 

i) The canonical dual solution is a global minimizer of 11'^ in (0, +00) since 
n'' is a strictly concave function and <,i is its only critical point in (0, +cx)). 
Since > 0, <;i) is a strictly convex function, then its only minimizer 
happens at its stationary point which is Xi. Also, S(a;, ^^i) < n(a;) for every 
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X] in fact, since V is a strictly convex function, by Fenchel's inequality for 
Convex functions we have that for every and every ^ 



rearranging the last inequality and adding — (/, x) to both sides we have 
S(a;, <?i) < n(a;) for every x e IR". 

Using Equation dTll . A(xi) = <;i/a, it can be easily shown that n(a;i) = 
S(a:i,<;i). With this, assume that there exists x' E J?" such that n(xi) > 
n(x') then 



Taking <; = ^^i and ^ = A(a::) 



<iiA{x)<V{A{x))+V%ii), 



n(xi) > n(a;') > S(x', <?i) > = n(a;i) 



which is a contradiction. Therefore xi is a solution of (P). 
ii) By the second derivative of XT', we have: 




Then 




2 



2A 



1 



3<?i + 2aX 



(20) 



a 



a 



For 1 = 3, V^IT'(<;^3) < and ^3 is a local maximizer of 11''. 



On the other hand, by differentiating we have: 



\7^n{x) = a (ra* + A{x)l) 



and 
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For 1 = 3, take any z E IR^: 



+ - zr = a 



therefore, by the Cauchy-Schwarz inequahty we have 



z'V^n(x3)z < a 



^3 " 



(21) 



But the expression in brackets is negative so z*V^n(a;3)z < for every 
z e and 11 has a focal maximizer at 2:3. 
iii) Using Equation ([20| with i = 2, we have that V^n'*(i;2) > and <;2 is a 
focal minimizer of 11''. 

On the other hand, by taking z e 5?", we know that = n(.X2 + tz) 
has first and second derivatives as follows: 

(l)'{t) = Vn(a;2 + tz)z, (l)"{t) = z*V^n(j;2 + tz)z. 

Cfoarly, 0'(O) = 0. What about 0"(O)? 



Consider the angle between z and /. Then 



"(0) = z^V^I].{x2)z = a 



{f.z? , ^2, ,2 



^1 



z = a 



|/|2|z|2cos2 , <J2, 



''2 



SO 



0"(O) = |z|2 ((2^2 + 2aA) cos^ 9 + ^2) 
If z G A'jj , by the definition of , we have that 



< J- 



^2 



2<;2 + 2aX ' 



Then 



cos < 



^2 

' 2^2 + 2aA 



a\z\^ ( ^ cos^ ^ + 1) ^ "1^1' ( + ^ + I 



(22) 
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(2<r2 + 2aX) cos^ < -^2 

(2^2 + 2a\) cos2 e + ^2 < 0. (23) 

So, substituting into (|22l) implies that, (t>"{0) < and i = is a local 
maximizer. 



If z G A],, then by definition, we have 



^2 



2^2 + 2aX 



< 



Then 



and this implies that 



^2 2 

< cos'' I 



2<;2 + 2aX 



< (2(^2 + 2aA)cos2 61 + (^2. 



(24) 



Thus, from the equation (f22|) we know that 0"(O) > and i = is a local 
minimizer. ■ 

Remark 1: The triality theory says precisely that if is a global maximizer 
of IT* on a certain set, then xi is a global minimizer for H. This is known from 
the general result by Gao and Strang in [lO| . If <^3 is a local maximizer for 11'' 
then X3 is also a local maximizer for 11. This is the so-called double-max duality 
statement. If ^2 is a local minimizer for 11'*, then X2 is also a local minimizer 
for n in certain directions. This is so-called double-min duality in the standard 
triality form proposed in 3|. The "certain additional constraint" discovered in 

nn 

[J, |5| is X — X2 + tX\j Vt G M. Part iii of Theorem [5] is showing that X2 is, in 
fact, a saddle point. This solves the open problem left in P, Q for this special 
case of double-well potential problem. 

Remark 2: If = 8a'^X^/27, then ^2=^3 = -2aX/3 and Equation 1^ 
implies that V'^n''(— 2aA/3) = 0, even more, it is not hard to show that this is 
an inflexion point of 11'*. The triality theory in this case can not tell us what 
kind of stationary point is for X2- However, Equation (|2ip remains true, and in 
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this case (recall that 2:3 — X2) the expression in brackets is zero. So this implies 
that z*V^n(a;2)2: < for every z E JR" and X2 is a local maximizer of H. 

It is clear that if / ~ 0, the problem (V) has infinite number of global 
minimizers, they all lie in the sphere \x\'^ — 2A. In this case, the canonical 
dual is strictly concave with only one local maximizer <;2, which leads to a 
local maximizer a: = of the primal problem. Therefore, a linear perturbation 
method has been introduced in 16] for solving some NP-hard problems in global 
optimization. The next theorem proves the convergence of this canonical dual 
perturbation method under the current setting. Notice that we want to find at 
least a solution of (T') if / = 0. 

Theorem 3. Consider (V) with / = 0. Let a, A e , fo e such that 
< l/op < 8a^A^/27 and consider fk = fo/k, for every k £ N. For i ^1,2, 3, 
take Q^fe the critical points ofHf which is the dual function induced by Ilk{x) = 
W{x) - (x, /fc), and Xi^k = fk/^i,k- Then 



Proof: Since Xi^k = fk/^i.k = fo/{k^i.k) we need to show that l/(fcQ,fe) con- 
verges for every i. Since fk is converging to zero, from equations ([8|)-(|10|). we can 
see that <ji^fc and <j2,fe both converge to zero and ^3,^ converges to —a\. Thanks 
to dl]) we know that 



lim xx^k — xi and jxip 



2A, 



lim X2,k — X2 and |a;2p 



2A, 



lim X3,fc = 0. 




which implies that 



k\<ii,k\ 



1 



V2(^ + A) 

l/ol 



With this, we have: 
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,1 ,1 , + V2X 
lim — = iini = lim — -— = , 

\/2(^ + ^) 



hm — r = - lim = hm — = — — , 

fe-)-oo k\^2,k\ fc^2,fe \jo\ \jo\ 



and 



lim — = — lim = lim — — — = -— ■ = 0. 

fc^oo k\(^3^k\ k^oo k<;3^k k^oo \fo\ \jo\ 



Finally, we have 



lim xi^k = lim ( 7^ ) fo = V2X-^, 



lim X2,k = lim ( 7^ ) fo = -~V2X-^, 

k^oo fe->oo V fc<j2,fe / \jo\ 



and 



lim X3,fc = lim ( 7^ ) /o = • = 0. 

fc— foo fc— ^00 \ k<^^^k J 

With all this, we have just proven that x\^k a-nd X2^k both converge to global 
minimizers of W ^ while ^3^^ converges to the local maximizer of W . I 

4. Examples 

Jf..l. Example 1: The case when / = 

Consider n = 2, a — \ and A = 3, just like in figure [Tbl In this case, the 
dual function is given by — — 0.5<;^ — 3<;. The graphs of the functions 11 

and n'^ are given in figure [31 Clearly, for 11, the local maximizer is at the origin 
and the global minimizers are in the sphere jxp = 6. While 11'^ does not have 
stationary points. 
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(a) U{x,y) = 0.5(0.5(a;2 +j/2) _ 3)2 (b) n'^(<;) = -0.5<;2 - 3?. 

Figure 3; Example 1 

4.2. Example 2: The case when < |/p < 8a'^\^/27 

Consider rt = 2, a = l, A = 3 and / — (1, 1). In this case, the lunctions 11 
and n'' are given in figure \E\ 

Using Equations (|8|)- (fT0|) . it is not hard to show that the three stationary 
points of n'' are = 2 -008 40°- 1, <?2 = 2 -cos 80° - 1 and ^3 = 2 -cos 160° - 1. 




(a) U{x,y) = 0.5(0.5{a;2+y2)_3)2_ n'*(<;) = (-1/^^) _ o.S?^ - 3?. 

x-y. 

Figure 4: Example 2 

Let us highhght that in this case, t = could be a minimizer or a maximizer 
of the function (j){t) — Il{x2 + tz), where X2 — //t2 and z G J?" is an arbitrary 
chosen vector. If we consider z ~ (1. —1) we have that the graph of is given 
by figure [5a| and if we consider z = (0.2, 1.4) we have that the graph of is 
given by figure I5bl 

Clearly, t = is a local maximizer for 0ifz = (l,— 1) and a local minimizer 
if z = (0.2,1.4). 
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(a) Function </> with z = (1, —1). (b) Function 4> with z = (0.2, 1.4). 

Figure 5: Function 



1.3. Example 3: The case when \f\^ = 8a^\^ /21 

Consider n = 2, a — 1, A = 3 and / — (2, 2). In this case, the functions 11 
and n'^ are given in figure El 




(a) n(a;, y) = 0.5(0.5{a;2 + j/2) _ 3)2 _ (b) n'*(<;) = (-4/?) - 0.5<;2 - 3? . 
2x - 2y. 

Figure 6; Example 3 

Using Equations ((8))- (fT0)) . it is not hard to show that the three stationary 
points of n'' are <;i — A/3, <;2 = ^3 = — 2A/3. 

4.4- Example 4- The case when 8q!^A^/27 < |/p 

Consider n = 2, a = l, A = 3 and / = (3, 3). In this case, the functions 11 
and n'^ are given in figure [T] 

From Equations ©-([T]), it is not hard to show that the only real stationary 
point of n'' is <ri . 
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(a) n(x,y) = 0.5(0.5{x2+j/2)_3)2. 
3x — 3y. 



(b) n^^C?) = (-9/.;) - 0.5?2 - 3?. 



Figure 7; Example 4 



5. Concluding Remarks 

A complete set of analytical solutions is presented in this paper for a noncon- 
vex optimization problem with double- well potential in J?". The open problem 
on the double-min duality left in 2003 has been solved for this special case. But 
the method and idea developed in this paper pave the way to prove the triality 
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theory in general global optimization problems 13 . 
Theorem 3 shows that if the primal problem has more than one global mini- 
mizer, the linear canonical dual perturbation method and the triality theory can 
be used for finding both global minimizer and local extrema. It was first realized 
in y that the primal problem could be NP-hard if it has more than one global 
minimizer. Therefore, this linear perturbation method should p lay a key role in 
solving some challenging problems in global optimization (see [18]). Nonlinear 
perturbation method for solving NP-hard integer programming problems has 
been discussed in 



References 

[1] Arnold, V. I. Mathematical Methods of Classical Mechanics. Springer- 
Verlag Berlin Heidelberg (1989, 2nd Edition). 

[2] Desoer, C. A.; Whalen, B. H. A Note on Pseudoinverses. Journal of the 
Society for Industrial and Applied Mathematics, Vol. 11, No 2, pp. 442-447 
(1963). 



16 



[3] Gao, D. Y. Duality Principles in nonconvex systems. Theory Methods 
and Applications. Kluwer Academic Publishers, Dordrecht/Boston/London 
(2000). 

[4] Gao, D. Y. Perfect duality theory and complete solutions to a class of global 
optimization problems. Optini. 52(4-5), 467-493(2003). 

[5] Gao, D. Y. Nonconvex semi-linear problems and canonical duality solu- 
tions., Advances in Mechanics and Mathematics, D.Y. Gao and R.W. 
Ogden (eds). Kluwer, 261-311 (2003) 

[6] Gao, D. Y. Solutions and optimality to box constrained nonconvex mini- 
mization problems. J. Ind. Manag. Optim. 3(2), 293-304, (2007). 

[7] Gao, D. Y. Canonical duality theory: theory, method, and applications in 
global optimization. Comput. Chem. 33, 1964-1972, (2009). 

[8] Gao, D. Y.; Ogden, R. W. Multiple solutions to non-convex variational 
problems with implications for phase transitions and numerical computa- 
tion. Quart. J. Mech. Appl. Math. 61 (4), 497-522 (2008). 

[9] Gao, D. Y.; Ruan, N. Solutions to quadratic minimization problems with 
box and integer constraints. J. Glob. Optim. 47(3): 463-484, (2010). 

[10] Gao, D. Y.; Strang, G. Geometric nonlinearity: Potential energy, comple- 
mentary energy, and the gap function. Quart. Appl. Math. 47(3), 487-504 
(1989). 

[11] Gao, D. Y.; Wu, C. Z. On the triality theory in global optimization. To 
appear in J. Industrial and Manegement Optimization. Also published in 
iarXrv:1104.2970l ^l at |http://arxiv.org/abs/1104.2976| 

[12] Peters, G.; Wilkinson J. H. The least squares problem and pseudo-inverses. 
The Computer Journal, Vol. 13, No 3, pp. 309-316 (1970). 

[13] Gao, D. Y.; Wu, C. Z. Triality theory for general unconstrained global 
optimization problems. To appear in J. Global Optimization. 

[14] Maxima.sourceforge.net. Maxima, a Computer Algebra System. Version 
5.22.1 (2010).lhttp:// maxima.sourceforge.net /| 

[15] Morales-Silva, D. M.; Gao, D. Y. Canonical duality theory and triality for 
solving general nonconstrained global optimization problems. To be submit- 
ted. 

[16] Ruan, N.; Gao, D. Y.; Jiao, Y. Canonical dual least square method for 
solving general nonlinear systems of quadratic equations. Comput Optim 
Appl, 47: 335-347 (2010). DOI 10.1007/sl0589-008-9222-5 

[17] Sewell, M.J. Maximum and minimum principles. Cambridge University 
Press, Cambridge, New York, Port Chester, Melbourne Sydney (1987). 



17 



[18] Wang, Z. B.; Fang, S. C; Gao, D. Y.; Xing, W. X. Canonical dual approach 
to solving the maximum cut problem. To appear in J. Global Optimization, 
(2011). 

[19] Zia, R. K. P.; Rcdish, E. F.; McKay S. R. Making Sense of the Legendre 
Transform American Journal of Physics, Vol. 77, Issue 7, pp. 614-622 
(2009). 



18 



